Skip to content

Conversation

JaredforReal
Copy link
Contributor

@JaredforReal JaredforReal commented Oct 4, 2025

What type of PR is this?
docs: container connectivity troubleshooting

What this PR does / why we need it:
Add documentation: Container Connectivity Troubleshooting based on practices.
add vsr-headers to sidebar.ts

@JaredforReal JaredforReal requested a review from Xunzhuo as a code owner October 4, 2025 16:21
Copy link

netlify bot commented Oct 4, 2025

Deploy Preview for vllm-semantic-router ready!

Name Link
🔨 Latest commit a39a573
🔍 Latest deploy log https://app.netlify.com/projects/vllm-semantic-router/deploys/68e14994d5e08800091c9b59
😎 Deploy Preview https://deploy-preview-346--vllm-semantic-router.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Copy link

github-actions bot commented Oct 4, 2025

👥 vLLM Semantic Team Notification

The following members have been identified for the changed files in this PR and have been automatically assigned:

📁 website

Owners: @Xunzhuo
Files changed:

  • website/docs/troubleshooting/container-connectivity.md
  • website/sidebars.ts

vLLM

🎉 Thanks for your contributions!

This comment was automatically generated based on the OWNER files in the repository.

@JaredforReal JaredforReal changed the title docs: add container connectivity docs & add vsr-headers to sidebar docs: container connectivity troubleshooting Oct 4, 2025

This guide summarizes common connectivity issues we hit when running the router with Docker Compose or Kubernetes and how we fixed them. It also covers the “No data” problem in Grafana and how to validate the full metrics chain.

## 1. Use IPv4 addresses for backend endpoints
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you check if similar kubernetes networking diagnostics help?
https://goteleport.com/blog/troubleshooting-kubernetes-networking/

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for sharing the link! I’ve checked it, and while it might be helpful, it doesn’t fully cover the issues I ran into on my lab servers. This PR is based on those practical troubleshooting experiences. Do you think it would make sense to keep both references, so the docs can complement each other?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, let's keep your inline diagnostics

@rootfs rootfs merged commit 9866881 into vllm-project:main Oct 5, 2025
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants